The documented low levels of reliability of the peer review process present a serious challenge to editors who must often base their publication decisions on conflicting referee recommendations. The purpose of this article is to discuss this process and examine ways to produce a more reliable and useful peer review system.

Rl In response to Somit & Peterson's call for multiple journal manuscript submissions, and consistent with Cicchetti (1991a and 1991b), counterarguments are presented. The policy for multiple submissions is difficult to defend scientifically ana would place an unwarranted burden on both reviewers and journal editors. As such the policy is again rejected. R2 As earlier hypothesized, referee agreement on manuscripts submitted to a major journal in chemistry was significantly higher for acceptance than for rejection. This is consistent with the high (...) acceptance rate (>70%) of this journal. There is significantly more referee agreement on rejection than on acceptance for manuscripts submitted to major journals, in behavioral science and medicine. These journals have high rejection rates (often >70%). (shrink)